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(57) Abstract 

A computer graphics 
system generates pixel 
values for pix'^Js in an 
images of objects in a scene, 
using strictly-detcnninistic 
low-discrepancy - sequences, 
illustratively Halton sequences, 
as sample points for evaluating 
integrals which are used to 
simulate a number of computer 
graphic techniques, including: 

(1) soft shadows generated for 
scenes illuminated by a light 
source having a finite extent, 
such as a disk, as opposed 
to a point light source; (2) 
simulation of depth of field; 
(3) motion blur, (4) jittering; 
and (5) global illumination. 
The computer graphics system 

uses the low-discrepancy mi • 

sequence: (1) in connection with soft shadows, to generate sample points over the finite extent of the light source iHummatmg the scene, 

(2) in connection with simulation of depth of field, to generate sample points over the area of the lens between the scene and the image, 
3 in connection with moUon blur, to generate sample points over a time interval over which motion blur is to be simulated for moving 

objects in the scene; (4) in comiection with jittering, to generate jittered sample points over an image or a plurahty of f^^^""^^^^^ 
and (5) in comiection with global illumination, to generate sample points for use in a strictly determmistic Russian roule^ niethodology 
for generating estimators for use in simulating global illumination. Unlike the random numbers used m connection with the Monte Carlo 
technique, the low discrepancy sequences ensure that the sample points are evenly distributed over a r^pective region orjjn^;;;^^^^^^ 
thereb? r^ucing error in the image which can result from clumping of such sample points which can occur m ttie Monte ^^^o^h^^^^^^^ 
In particular, thi invention facilitotes the generation of images of improved quality when using the same number of sample pomts at the 
same computational cost as in the Monte Carlo technique. 
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SYSTEM AND METHOD FOR GENERATING PIXEL VALUES 

Field Of The Invention 

The invention relates generally to the field of computer graphics, and more particularly to 
systems and methods for generating pixel values for pixels in the image. 

Background Of The Invention 

In computer graphics, a computer is used to generate digital data that represents the 
projection of surfaces of objects in, for example, a three-dimensional scene, illuminated by one or 
more light sources, onto a two-dimensional image plane, to simulate the recording of the scene by, 
for example, a camera. The camera may include a lens for projecting the image of the scene onto 
the image plane, or it may comprise a pinhole camera in which case no lens is used. The two- 
dimensional image is in the form of an array of picture elements (which are variable termed "pixels" 
or "pels"), and the digital data generated for each pixel represents the color and luminance of the 
scene as projected onto the image plane at the point of the respective pixel in the image plane. The 
surfaces of the objects may have any of a number of characteristics, including shape, color, 
specularity, texture, and so forth, which are preferably rendered in the image as closely as possible, 
to provide a realistic-looking image. 

Generally, the contributions of the light reflected from the various points in the scene to the 
pixel value representing the color and intensity of a particular pixel are expressed in the form of the 
one or more integrals of relatively complicated functions. Since the integrals used in computer 
graphics generally will not have a closed-form solution, numerical methods must be used to evaluate 
them and thereby generate the pixel value. Typically, a conventional "Monte Carlo" method has been 
used in computer graphics to numerically evaluate the integrals. Generally, in the Monte Carlo 
method, to evaluate an integral 

</> = / /(^) ^ (1)' 

0 
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where f(x) is a real function on the real numerical interval from zero to 1, inclusive, first a number 
•*N" statistically-independent random numbers x, , i=l, N, are generated over the interval. The 
random numbers are used as sample points for which sample values f(Xi) are generated for the 
function f(x), and an estimate / for the integral is generated as 

/V 1 = 1 



As the number of random numbers used in generating the sample points f(Xi) increases, the value of 
the estimate/ will converge toward the actual value of the integral <f>. Generally, the distribution 
of estimate values that will be generated for various values of "N," that is, for various numbers of 
samples, of being normal distributed around the actual value with a standard deviation o which can 
be estimated by 



o = 



1 .75 



if the values x, used to generate the sample values f(Xi) are statistically independent, that is, if the 
values Xj are truly generated at random- 

Generally, it has been believed that random methodologies like the Monte Carlo method are 
necessary to ensure that undesirable artifacts, such as Moire patterns and aliasing and the like, which 
are not in the scene, will not be generated in the generated image. However, several problems arise 
from use of the Monte Carlo method in computer graphics. First, since the sample points Xj used in 
the Monte Carlo method are randomly distributed, they may not be generally evenly distributed 
across the interval, but instead may clump in various regions over the interval over which the integral 
is to be evaluated. Accordingly, depending on the set of random numbers which are generated, in 
the Monte Carlo method for significant portions of the interval there may be no sample points X; for 
which sample values f(Xi) are generated. In that case, the error can become quite large. In the 
context of generating a pixel value in computer graphics, the pixel value that is acmally generated 
using the Monte Carlo method may not reflect some elements which might otherwise be reflected 
if the sample points X; were guaranteed to be generally evenly distributed over the interval. This 
problem can be alleviated somewhat by dividing the interval into a pluraUty of sub-inteivals, but it 
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is generally difficult to determine a priori the number of sub-intervals into which the interval should 
be divided, and, in addition, in a multi-dimensional integration region (which would actually be used 
in computer graphics, instead of the one-dimensional interval described here) the partitioning of the 
region into sub-regions of equal size can be quite complicated. 

In addition, since the method makes use of random numbers, the error 1/ " </> I (where 
|x! represents the absolute value of the value "x") between the estimate value / and actual value <f> 
is probabalistic, and, since the error values for various values of "N" are normal distributed around 
the actual value <f^, only sixty-eight percent of the estimate values 7 that might be generated are 
guaranteed to lie within one standard deviation of the actual value <f>. 

Furthermore, as is clear from equation (3), the standard deviation o decreases with increasing 

numbers of samples N, proportional to the reciprocal of square root of "N" (that is, 1 / v^). Thus, 
if it is desired to reduce the statistical error by a factor of two, it will be necessary to increase the 
number of samples N by a factor of four, which, in turn, increases the computational load that is 
required to generate the pixel values, for each of the numerous pixels in the image. 

Additionally, since the Monte Carlo method requires random numbers, an efficient 
mechanism for generating random numbers is needed. Generally, digital coinputers are provided 
with so-called "random number" generators, which are computer programs which can be processed 
to generate a set of numbers that are approximately random. Since the random number generators 
use deterministic techniques, the numbers that are generated are not truly random. However, the 
property that subsequent random numbers from a random number generator are statistically 
independent should be maintained by deterministic implementations of pseudo-random numbers on 
a computer. 

Summary Of The Invention 

The invention provides a new and improved computer graphics system and method for 
generating pixel values for pixels in the image using a strictly deterministic methodology for 
generating sample points for use in evaluating integrals defining aspects of the image. 

In brief summary, the computer graphics system in accordance with the invention generates 
pixel values for pixels in an image of objects in a scene, using strictly-deterministic low-discrepancy 
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sequences, illustratively Halton sequences, as sample points for evaluating integrals which are used 
to simulate a number of computer graphic techniques, including 

(1) soft shadows generated for scenes illuminated by a light source having an area, such as 
a disk, as opposed to a point light source; 

(2) Simulation of depth of field; 

(3) motion blur; 

(4) jittering; and 

(5) global illumination.. 

The computer graphics system uses the low-discrepancy sequences: 

(1) in connection with soft shadows , to generate sample points over the area of the light 
source illuminating the scene; 

(2) in connection with simulation of depth of field, to generate sample points over the area 
of the lens between the scene and the image; 

(3) in connection with motion blur, to generate sample points over a time interval over which 
motion blur is to be simulated for moving objects in the scene; 

(4) in connection with jittering, to generate jittered sample points over an image or a plurality 

of contiguous pixels; and 

(5) in connection with global illumination, to generate sample points for use in a strictly- 
deterministic Russian roulette methodology for generating estimators for use in simulating global 
illumination. 

Unlike the random numbers used in connection with the Monte Carlo technique, the low discrepancy 
sequences ensure that the sample points are evenly distributed over a respective region or time 
interval, thereby reducing error in the image which can result from clumping of such sample points 
which can occur in the Monte Carlo technique. 

BRIEF Description Of The Drawings 

This invention is pointed out with particularity in the appended claims. The above and 
further advantages of this invention may be better understood by referring to the following 
description taken in conjunction with the accompanying drawings, in which: 

FIG. 1 depicts a computer graphics system constructed in accordance with the invention; and 
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FIGS. 2 through 6B are flow-charts useful in understanding the operations of the computer 
graphics system depicted in FIG. 1 , in accordance with the invention. 

DETAILED DESCRIPTION OF AN ILLUSTRATIVE EMBODIMENT 

The invention provides a computer graphic system and method for generating pixel values 
for pixels in an image of a scene, which makes use of a strictly-deterministic methodology for 
generating sample points for use in generating sample values for evaluating the integral or integrals 
whose function(s) represent the contributions of the light reflected from the various points in the 
scene to the respective pixel value, rather than the random or pseudo-random Monte Carlo 
methodology which has been used in the past. The strictly-deterministic methodology ensures a 
priori that the sample points will be generally evenly distributed over the interval or region over 
which the integral(s) is (are) to be evaluated in a low-discrepancy manner. 

FIG. 1 attached hereto depicts an illustrative computer system 10 that.makes use of such a 
strictly deterministic methodology. With reference to FIG. 1. the computer system 10 in one 
embodiment includes a processor module 1 1 and operator interface elements comprising operator 
input components such as a keyboard 1 2 A and/or a mouse 1 2B (generally identified as operator input 
element(s) 12) and an operator output element such as a video display device 13. The illustrative 
computer system 10 is of the conventional stored-program computer architecture. The processor 
module 1 1 includes, for example, processor, memory and mass storage devices such as disk and/or 
tape storage elements (not separately shown) which perform processing and storage operations in 
connection with digital data provided thereto. The operator input element(s) 12 are provided to 
permit an operator to input information for processing. The video display device 13 is provided to 
display output information generated by the processor module 1 1 on a screen 14 to the operator, 
including data that the operator may input for processing, information that the operator may input 
to control processing, as well as information generated during processing. The processor module 
1 1 generates information for display by the video display device 13 using a so-called "graphical user 
interface" ("GUI"), in which infomiation for various applications programs is displayed using 
various "windows." Although the computer system 10 is shown as comprising particular 
components, such as the keyboard 12A and mouse 12B for receiving input information from an 
operator, and a video display device 1 3 for displaying output information to the operator, it will be 
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appreciated that the computer system 10 may include a variety of components in addition to or 
instead of those depicted in FIG. 1 . 

In addition, the processor module 1 1 includes one or more network ports, generally identified 
by reference numeral 14, which are connected to communication links which connect the computer 
system 10 in a computer network. The network ports enable the computer system 10 to transmit 
information to, and receive information from, other computer systems and other devices in the 
network. In a typical network organized according to, for example, the client-server paradigm, 
certain computer systems in the network are designated as servers, which store data and programs 
(generally, "information") for processing by the other, client computer systems, thereby to enable 
the client computer systems to conveniently share the information. A client computer system which 
needs access to information maintained by a particular server will enable the server to download the 
information to it over the network. After processing the data, the cUent computer system may also 
return the processed data to the server for storage. In addition to computer systems (including the 
above-described servers and cUents), a network may also include, for example, printers and facsimile 
devices, digital audio or video storage and distribution devices, and the like, which may be shared 
among the various computer systems connected in the network. The communication links 
interconnecting the computer systems in the network may, as is conventional, comprise any 
convenient information-carrying medium, including wires, optical fibers or other media for carrying 
signals among the computer systems. Computer systems transfer information over the network by 
means of messages transferred over the communication Unks, with each message including 
information and an identifier identifying the device to receive the message. 

As noted above, the computer graphics system 10 generates pixel values for pixels in an 
image of a scene, which makes use of a strictly-deterministic methodology for selecting sample 
points used to generate sample values which are then used in evaluating the integral or integrals 
whose function(s) represent the contributions of the Ught reflected from the various points in the 
scene to the respective pixel value. In one particular embodiment, the strictly-deterministic 
methodology used by the computer graphics system 10 provides a low-discrepancy sample point 
sequence which ensures, a priori, that the sample points are generally evenly distributed throughout 
the region over which the respective integrals are being evaluated. In one embodiment, the sample 
points that are used are based on a so-called Halton sequence. See, for example, J. H. Halton, 
Numerische Mathematik, Vol. 2, pp. 84-90 (1960) and W. H. Press, et al., Numerical Recipes in 
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Fortran (2d Edition) page 300 (Cambridge University Press, 1 992). In a Halton sequence generated 
for number base "p," where base "p" is a selected prime number, the "k-th" value of the sequence, 

represented by Hp" is generated by 

(1 ) writing the value "k" as a numerical representation of the value in the selected base 
"p," thereby to provide a representation for the value as D^D^^^ , D^D^ , where D„ 

(m=l, 2, M) are the digits of the representation, and 

(2) putting a radix point (corresponding to a decimal point for numbers written in base 
ten) at the end of the representation DJ)^,, D^D^ written in step (1 ) above, aiad 
reflecting the digits around the radix point to provide O.D^D^ D^,^D^^, which 
corresponds to Hp". 

It will be appreciated that, regardless of the base "p" selected for the representation, for any series 
of values, one, two, ... "k," written in base "p," the least significant digits of the representation will 
change at a faster rate than the most significant digits. As a result, in the Halton sequence Hp', Hp^ 
...Hp", the most significant digits will change at the faster rate, so that the early values in the sequence 
will be generally widely distributed over the interval fi-om zero to one, and later values in the 
sequence will fill in interstices among the earlier values in the sequence. UnUke the random or 
pseudo-random numbers used in the Monte Carlo method as described above, the values of the 
Halton sequence are not statistically independent; on the contrary, the values of the Halton sequence 
are strictly deterministic, "maximally avoiding" each other over the interval, and so they will not 
clump, whereas therandomorpseudo-randomnumbers used in theMonteCarlomethodmayclump. 

It will be appreciated that the Halton sequence as described above provides a sequence of 
values over the interval from zero to one, inclusive along a single dimension. A multi-dimensional 
Halton sequence can be generated inasimilarmanner.butusingadifferent base for each dimension. 

A generalized Halton sequence, of which the Halton sequence described above is a special 
case, is generated as follows. For each starting point along the numerical interval from zero to one, 
inclusive a different Halton sequence is generated. Defining the pseudo-sum xepy for any x and y 
over the interval from zero to one, inclusive, for any integer "p" having a value greater than two, the 
pseudo-sum is formed by adding the digits representing "x" and "y" in reverse order, from the most- 
significant digit to the least-significant digit, and for each addition also adding in the carry generated 
from the sum of next more significant digits. Thus, if "x" in base "p" is represented by 
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0,X X X X,,, where each "X," is a digit in base "p," and if "y" in base "p" is represented by 

Q,YY Y y where each is a digit in base "p" (and where "M," the number of digits in the 

representation of "x" in base "p", and "N," the number of digits in the representation of "y" in base 
"p", may differ), then the pseudo-sum "z" is represented by O.ZjZ^ Z^.,Z^, where each "Z," is a 

digit in base "p" given by Z, = ( + + ) mod p , where "mod" represents the modulo function. 



and C, 



and C] is set to zero. 
0 otherwise 



Using the pseudo-sum function as described above, the generalized Halton sequence is 
generated as follows. If "p" is an integer, and Xq is an arbitrary value on the interval from zero to 
one, inclusive, then the "p"-adic von Neumann-Kakutani transformation Tp(x) is given by 



T (x) := (4), 



and the generalized Halton sequence Xo, Xj, Xz. ... is defined recursively as 

From equations (4) and (5), it is clear that, for any value for "p." the generalized Halton sequence 
can provide a different sequence will be generated for each starting value of "x," that is, for each Xo- 
It will be appreciated that the Halton sequence Hp" as described above is a special case of the 
generalized Halton sequence (equations (4) and (5)) for Xo=0. 

The use of the low-discrepancy sequence in evaluating integrals to generate pixel values for 
pixels in an image in computer graphics will be illustrated in connection several specific computer 
applications, in particular, the generation of pixel values for images representing 

( 1 ) soft shadows generated for scenes illuminated by a light source having an area, such as 
a disk, as opposed to a point light source; 

(2) Simulation of depth of field; 

(3) motion blur; 

(4) jittering; and 

(5) global illumination.. 
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Operations performed by the computer graphics system 1 0 in connection with each of these will be 

described below. 

(1) Soft Shadows 

Soft shadows can occur in a scene when objects in the scene are illuminated by a light source 
having an identifiable area, such as a disk, instead of a point light source. Illustratively, when a solar 
eclipse occurs, the penumbra portion of the shadow cast by the moon on the earth is a soft shadow, 
and the umbra portion constitutes a full shadow. The umbra portion of the eclipse occurs in regions 
of the earth for which the moon completely obscures the sun, and the penumbra portion occurs in 
regions for which the moon partially obscures the sun. The degree of shadow in the penumbra 
lessens as one proceeds outwardly from the umbra, and the penumbra constitutes the "soft shadow" 
for the eclipse. For a particular shadow in a scene, the soft shadow represents a grading from the 
region (if any) of the scene that is in ftill shadow to the region for which there is no shadow. 

In a scene, a portion of a pixel value for a point in a scene representing illumination by a light 
source having an area is generated by averaging the illumination of a particular point in a scene by 
a light source over the area of the light source. If the point in the scene is in a fiill shadow region, 
which may occur if the point is completely obscured by one or more objects in the scene, then the 
average will represent a luminance level representative of fiill shadow. Similarly, if the point is in 
a no-shadow region, then the average will represent a luminance level representative of no shadow. 
On the other hand, if the poim is partially obscured from the fiill area of the Ught source by objects 
in the scene, and thus is in a soft shadow region, then the average will represent an intermediate 
luminance level based on the amount of the light source that is obscured. In any case, the average 
is given illustratively by the two-dimensional integral 



I L ( 

J \x-x'\' ' 



jCx) - J ll^^LSx')dA' (6), 

A' 

Where (x)is a point in the scene for which the illumination value is being generated, (x 0 is a point 
on the area light source, /(J) represents the illumination at the point (i) in the scene, x ) 
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denotes the level of light emission of the area light source, and V(x , x 0 is a visibility function that 
equals one if the point (x ^on the light source is visible from the point (x) in the scene and zero if 
the if the point (x ^on the light source is not visible from the point (x) in the scene. The integral is 

evaluated over the area A' of the light source. The formulation of the fiinction — L (x ) for 

\X'X'\' 

a particular image is known to one of skill in the art. 

In accordance with the invention, the computer graphics system 10 evaluates the integral 

(equation (6)) to generate a pixel value by selecting a number "N" of sample points (x /) using a two- 
dimensional generalized Halton sequence. After the sample points (x/) are generated, the computer 
graphics system 10 evaluates the function 



for each of the generated sample points and approximates the value of the integral (equation (6)) as 
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for each of the points (i) in the scene for which the illumination value /(i) is to be generated. The 

use of a low-discrepancy sequence, illustratively the Halton sequence, will ensure that the sample 
points will not clump, but instead will be evenly distributed over the area of the light source. 

In one embodiment, for each of the points (i) in the scene for which the illumination value 
/(i)istobegenerated,thecomputergraphicssystemlOusesadifrerentHaltonsequence,generated 

in accordance with the generalized Halton sequence methodology described above (equation (5)), 
so as to avoid generating pixel values for which the soft shadows might otherwise appear blocky . 
In that embodiment, theparticular Halton sequence is generated usingabasevalueXoWh,ch.sbased 

on the coordinates of the point in the image for which the pixel value is being generated that xs 

associated with the point (x) in the scene. 

Operationsdescribedaboveincomiectionwiththegenerationofpixelvaluessoastoprovide 

soft shadows are depicted on the flow-chart in FIG. 2. Since the operations as depicted in that flow- 
chart will be readily apparent to those skilled in the art from the above description, the flow-chart 
in that FIG. will not be separately described in this specification. 

... u ^'^^^JL!^ / /"v'-k used in equation (6) is illustrative 

It will be appreciated that the ftmction — — — ^e^^ ' ^ 

I *.-x I 

of .he fmcticns tt.a, can be -.ed ix. connection wift generation of pixel values ,0 simulate soft 
shadows, and other functions will be apparent to those skilled in the art, with conrespondtng changes 

in equations (7) and (8). For example, although in the denominator °f jJT^j^ *° 

term "I J - ;T is indicated as being taken to tite second power (that is, squar«i), it will be 

appreciated that other powet. can be used, in which case equations (7) and (8) would be modified 
dingly. In addition, although the Halton sequence has been indicated as being used to prov.de 



accop 
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the sample points for the evaluation, it will be appreciated that other low-discrepancy sequences, 
which are known in the art, could be used instead. 

In addition, it will be appreciated that, although the computer graphics system 10 has been 
described as simulating soft shadows in connection with area light sources, the computer graphics 
system 1 0 can also simulate soft shadows in connection with a linear light source in a manner similar 
to that described above. As with simulation of soft shadows for an area light source, the computer 

graphics system 10 will constrain the sample points(x/) to fall on the light source. In addition, if 
the light source is a linear light source, the computer graphics system 10 can generate the sample 
points (x/) using a one-dimensional generalized Halton sequence. 



(2) Depth of Field Simulation 

As noted above, 'the computer graphics system 10-can generate pixel values defining a 
rendered image representing an image which would be recorded for a pinhole camera, or 
alternatively it can generate pixel values defining a rendered image representing an image which 
would be recorded for a camera with a lens. Typically, for a camera without a lens, all of the objects 
are normally in focus. However, for a conventional camera with a lens, the objects at a particular 
distance from the lens, as well as objects within a plane of predetermined distance thereof, known 
as the "depth of field" would be in focus. For objects which are closer or mtore distant, the objects 

would be increasingly blurred. 

To simulate generation of an image for a camera with a depth of field, the computer graphics 
system 10 generates a pixel value for each pixel based on the evaluation of the integral 



Lix,y) = jLix,y,x',y')dx'dy' 



(9), 



where Lix ,y,x ',y ') denotes the luminance coming fi-om the point (x',y') on the lens in the direction 
of the point (x,y) in the image plane. The computer graphics system 10 evaluates the integral over 
the area A^^ of the lens. The formulation of the fimction Lix,y,x',y') for a particular image is 
known to one of skill in the art. 
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In accordance with the invention, the computer graphics system 10 evaluates the integral 
(equation (9)) to generate a pixel value by selecting a number "N" of sample points for points (x^ ,yi) 
on the lens using the Halton sequence to provide the sample points. After the sample points are 
generated, the computer graphics system 10 evaluates the function L(x,y,x \y') for each of the 
"N" sample points (x^, y^) and approximates the integral (equation (9)) as 

Lix^y) = ^^Lix,y,x^,y^) (10), 

1=1 



In one particular embodiment, for each point (x^ .yj) on the image plane, the computer graphics 
system 10 uses a different Halton sequence, generated in accordance with the generalized Halton 
sequence methodology described above (equation (5)), so as to avoid generating pixel values for 
which the rendered image might otherwise appear blocky. In that embodiment, the particular Halton 
sequence is generated using a base value Xo which is based on the coordinates of the point in the 
image for which the pixel value is being generated that is associated with the point (xj, y;) m the 
image plane. The use of a low-discrepancy sequence, illustratively the Halton sequence, will ensure 
that the sample points will not clump, but instead will be evenly distributed over the area of the lens. 

Operations described above in connection with the generation of pixel values so as to provide 
depth of field are depicted on the flow-chart in FIG. 3 . Since the operations as depicted in that flow- 
chart will be readily apparent to those skilled in the art from the above description, the flow-chart 
in that FIG. will not be separately described in this specification. 

The use of sample points (xO selected as described above for the evaluation of the integral 
(equation (9)) is advantageous in that the use of the low-discrepancy set of sample points has a "self- 
avoiding" property that ensures that the sample points will not be clumped together, which clumping 
is possible with prior methodologies such as the random-number-based Monte Carlo method. A 
further advantage is that the number of sample points (Xj) does not need to be selected opr/ori prior 
to the computation. 

It will be appreciated that the fimction Lix,y,x ' ,y ') used in equation (9) is illustrative of 
the functions that can be used in connection with generation of pixel values to simulate depth of 
field, and other functions will be apparent to those skilled in the art, with corresponding changes in 
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equation ( 1 0), In addition, although the Halton sequence has been indicated as being used to provide 
the sample points for the evaluation, it v^^ill be appreciated that other low-discrepancy sequences, 
which are known in the art, could be used instead, 

(3) Motion Blur 

Motion blur occurs when, for example, an object in a scene being recorded by a stationary 
camera is moving. The motion blur occurs because the camera's shutter has a non-zero time mterval 
over which it is open, and, if the camera is not moved to so as to maintain the moving object at 
precisely the same point in the image, the point at which the moving object appears in the image 
moves over the time interval. Accordingly, edges of the object which are transverse to the direction 
of motion appears to be blurred over the image. 

To simulate generation of an image of a scene in which an object is moving, by a camera 
whose shutter has a non-zero time interval over which it is open, the computer graphics system 10 
generates a pixel value for each pixel based on the evaluation of the integral 



where L(x,y) is the luminance of point (x,y), L(x,y,t) is the luminance of point (x,y) in the image 
at time "t," and "tg" is the time period over which the shutter is open. It will be appreciated that 
L(x,y) is essentially the average of L(x,y,t) over time ts- The formulation of the function L(x,y,t) for 



In accordance with the invention, the computer graphics system 10 evaluates the integral 
(equation (1 1)) to generate a pixel value by selecting a number "N" of sample points for points (t^) 
over the time interval from zero to tg using the Halton sequence to provide the sample points. After 
the sample points are generated, the computer graphics system 10 evaluates the function L(x,y,t) for 
each of the "N" sample points (t^) and approximates the integral (equation (1 1 )) as 




(11) 



a particular image is known to one of skill in the art. 




(12) 
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In one particular embodiment, for each pixel in the image, the computer graphics system 1 0 uses a 
different generalized Halton sequence, generated in accordance with the generalized Halton sequence 
methodology described above (equation (5)), so as to avoid generating pixel values for which the 
rendered image might otherwise appear blocky. In that embodiment, the particular Halton sequence 
is generated using a base value Xq which is based on the coordinates of the point (x,y) in the image 
for which the pixel value is being generated. The use of a low-discrepancy sequence, illustratively 
the Halton sequence, will ensure that the sample points will not clump, but instead will be evenly 
distributed over the time period over which the integral (equation (1 1) is to be evaluated). 

Operations described above in connection with the generation of pixel values so as to provide 
motion blur are depicted on the flow-chart in FIG. 4. Since the operations as depicted in that flow- 
chart will be readily apparent to those skilled in the art from die above description, the flow-chart 
in that FIG. will not be separately described in this specification. 

It will be appreciated that the function L(x,y,t) used in equation (11) is illustrative of the 
functions that can' be used in connection with generation of pixel values to simulate depth of field, 
and other fimctions will be apparent to those skilled in the art, with corresponding changes in 
equation ( 1 2). In addition, although the Halton sequence has been indicated as being used to provide 
the sample points for the evaluation, it will be appreciated that other low-discrepancy sequences, 
which are known in the art, could be used instead. 

In addition, it will be appreciated that the computer graphics system 10 may use a one- 
dimensional Halton sequence to generate sample points (tj) for use in equation (12) along a temporal 
dimension "t" for each sample point (x,y) in the image. In that case, during generation of the pixel 
value, the computer graphics system 1 0 will generate the luminance value L(x,y) for the sample point 
(x,y) in accordance with equation (12). Alternatively, the computer graphics system 10 may use, for 
example, a three-dimensional Halton sequence to generate sample points (Xi,y„ti) along both the 
temporal dimension "t" and spatial dimensions "x" and "y" of the image plane, for use in equation 
(12), and can generate the luminance value for the pixel using equation (12) using the luminance 
values L(Xi,yj,ti), where (Xi.,yi) are sample points within the region of the pixel. 
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(4) Jittering 

To generate a pixel value for a pixel which represents the color of the pixel at the respective 
point in the image, the color represented by the pixel value is averaged over the area of the pixel. 
To simulate that, the computer graphics system 10 generates the pixel value for pixel P, to have an 
averaged color L, by evaluating the integral 



Lix,y)dxdy (13), 



where L(x,y) represents the color at point (x,y) in the image, and |Pi | represents the area of the pixel 
P,. The formulation of the function L(x,y) for a particular image is known to one of skill in the art. 

The computer graphics system 1 0 can evaluate the integral (equation ( 1 3)) to generate a pixel 
value by selecting a number "N" of sample points ix,,yd in the pixel using the Halton sequence 
to provide the sample points. After the sample points are generated, the computer graphics system 
10 evaluates the function L(x,y) for each of the "N" sample points (x^.y^) and approximates the 
integral (equation (13)) as 



Several problems arise, however, if the integral (equation (13)) is evaluated using a Halton sequence 
generated for each pixel. First, although the Halton sequence guarantees that no clumping occurs 
within a single pixel, it will not guarantee that clumping will not occur at boundaries of adjacem 
pixels. In addition, the Halton sequences generated for the pixels would exhibit periodicity on the 
pixel level, in which case artifacts may be generated in the image which can be evident to the eye. 

Thus, to accommodate these problems, in accordance with the invention, the computer 
graphics system 1 0 generates the Halton sequence to generate the sample points either for the image 
as a whole or for a predetermined number of contiguous pixels in the following manner. Initially, 
the computer graphics system 10 divides the image or the predetermined number of contiguous 
pixels based on a grid of size "n" by "m," where n=2* is a positive power ("i") of two and m=3i is a 
positive power ("j") of three. (In this description, two and three are the number bases (that is, "p" 
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in equations 4 and 5 describing the one-dimensional Halton sequence) selected for generation of the 
two-dimensional Halton sequence; if the computer graphics system 1 0 uses other number bases for 
generation of the two-dimensional Halton sequence, then "n" and "m" would be selected to be 
powers of those number bases.) Then the computer graphics system 10 generates the set of sample 
points (x„yi) to be used in evaluating equation (14) as ( nHz" . mHj" ) for k=I, ... ,nm, which 
constitutes a scaled two-dimensional Halton sequence, with the scaling being in accordance with the 
values of "n" and "m". The sample points so generated, precisely one sample point will be provided 
in each of a plurality of sub-pixels in each pixel, if the left and lower boundaries of each sub-pixel 
are deemed to form part of the sub-pixel and the right and upper boundaries of each sub-pixel are 
deemed not to form part of the sub-pixel. 

For example, if the computer graphics system 10 is to generate sample points on "N" by "N" 
sub-pixels for each pixel, and if the number of columns in the image or the selected sub-set of 
contiguous pixels is Res,, and if the number of rows of pixels in the image or the selected sub-set 
of contiguous pixels is ReSy, then the computer graphics system 10 -can generate a number of 
N-Res, X NRes„ of sample points to be used with the pixels in the image or selected subset of pixels 
by initially selecting integers "i" and "j" such that n=2* ^N-Res, and m=y j:N-ReSy . Note that the sub- 
pixel grid of "n" by "m" sub-pixels will in general be larger than the size of the image or selected 
subset of contiguous pixels. 

According to the mechanism described above, the computer graphics system 10 can evaluate 
the integral in equation (14) for each pixel usiiig the sample points which are provided within the 
area of the respective pixel. 

Several benefits arise from generating sample points using the scaled two-dimensional Halton 
sequence ( nHj" , mHj'' ) for the entire image or selected sub-set of contiguous pixels in evaluating 
the integral in equation (14), instead of using the unsealed Halton sequence (that is, illustratively, 
( Hz'' , Hj"" )) within one pixel as the sample points. First, by using a scaled two-dimensional Halton 
sequence, periodicity of the sample points on the level of a pixel, which can occur in connection with 
the unsealed two-dimensional Halton sequence, will be avoided. In addition, the use of a scaled two- 
dimensional Halton sequence ( nHj" , mHj'' ) will ensure that no clumping of sample points will 
occur at the boundaries of adjacent pixels, which can occur in connection with the unsealed two- 
dimensional Halton sequence. Therefore, the use of a scaled two-dimensional Halton sequence 
( nH,'' , mHj'' ) will ensure that the sample points will be evenly distributed throughout the entire 
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image or contiguous region of pixels. This will also be the case if relatively few sample points are 
used, and even if only one sample point per pixel is used. 

Operations described above in connection with the generation of pixel values so as to provide 
jittering are depicted on the flow-chart in FIG. 5. Since the operations as depicted in that flow-chart 
will be readily apparent to those skilled in the art from the above description, the flow-chart in that 
FIG. will not be separately described in this specification. 

(5) Global Illumination 

"Global illumination" includes a class of optical effects, such as indirect illumination, diffuse 
and glossy inter-reflections, caustics and color bleeding, which the computer graphics system 10 
simulates in generating an image of objects in a scene. For the simulation of global illumination, a 
"rendering equation" is solved. For the general form of an illustrative rendering equation useful in 
global illumination simulation, namely: 

it is recognized that the light radiated at a particular point x in a scene is generally the sum of two 

components, namely, the amount of light (if any) that is emitted from the point and the amount of 
light (if any) which originates from all other points and which is reflected or otherwise scattered from 

the point x . In equation (15), Z(x,w) represents the radiance at the point x in the direction 
w =(6,4)) (where "6" represents the angle of direction w relative to a direction orthogonal of the 
surface of the object in the scene containing the point x , and "(|)" represents the angle of the 
component of direction w in a plane tangential to the pointx ), Similarly, I (x w 0 in the integral 
represents the radiance at the point P in the direction = (6^4)0 (where "6'" represents the angle 
of direction w ' relative to a direction orthogonal of the surface of the object in the scene containing 
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the point x ' , and "(J)"' represents the angle of the component of direction w ' in a plane tangential 

to the point x ' ), and represents the light, if any, that is emitted from point x ' which may be reflected 

or otherwise scattered from point x . 

In equation {\S),L^(i,w) represents the first component of the sum, namely, the radiance 
due to emission from the point x in the direction ^, and the integral over the sphere S' represents 
the second component, namely, the radiance due to scattering of light at point x. /(x ,w ' - w) is 
a bidirectional scattering distribution function which describes how much of the light coming from 
direction is reflected, refracted or otherwise scattered in the direction w , and is generally the sum 
of a diffuse component, a glossy component and a specular component. In equation (15). the 
function G(x,x') is a geometric term 

gCx,x') - (16), 

\x-x'\'- 

where 6 and e'are angles relative to the normals of the respective surfaces at points x and x' , 
respectively. Further in equation (15), V{x,x') is a visibility function which equals the value one 
if the point x'xs visible from the point x and zero if the point ^'is not visible from the point x . The 
formulation of the various functions L (x ,w), L (x ',w 0, ,w), f{x .y, ^) ,G{x ,x ') and 
V(x ,x ') for a particular image is known to one of skill in the art. 
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The computer graphics system 10 uses global illumination and the rendering equation, 
namely, equation (15), in connection with generation of an image to simulate a number of optical 
effects as noted above. In particular, in connection with one aspect of simulation using ray tracing, 
in which the computer graphics system 1 0 simulates an image as viewed by an observer by tracing 
rays, representing photons, from a light source to the eye of the observer, in accordance with the 
invention the computer graphics system 10 uses a "strictly deterministic Russian roulette" 
methodology to determine whether or not to terminate a simulated ray, using a strictly-deterministic 
method in that determination. 

By way of background, an equation such as the equation (15) of the form 

1 

Ax) = gix) ^ [ K(x,y)fiy)dy (17) 

0 

where f(x) (and similarly f(y)) is an unknown function, g(x) is a known function (in the context of 
the rendering equation (equation (15)) g(x) = {x ,w)) and K(x,y) is another known function 
which serves as a "kernel" of the integral operator (in the context of the rendering equation (equation 
15), Kix.w) = /(Jc,w'-w)G(x,xO r(x,x')Xcanbeformallysolvedbyrepeatedlysubstituting 

the function "f in the integral, as follows: 

/(X) = gix) - f K{x.x^)gix;)dx^ ^ f f Kix,x^)K(x^.x^)gix^)dx^dx^ 

0 0 0 (18). 

1 1 I 

0 0 0 



which constitutes an infinite Neumann series. Equation (17), in turn, can be approximately 
numerically evaluated by performing a low-discrepancy sampling of the first "L" terms of the 
Neumann series in equation (18), where "g(x)" is considered as a zeroth term, using an "L"- 
dimensional low-discrepancy sequence (5/"\ ), where "n" denotes a sequence index. In one 

embodiment, an "L" -dimensional low-discrepancy sequence is illustratively an L-dimensional Halton 
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sequence, for which, as described above, the elements of the sequence tend to maximally avoid one 
another. For each element of the sequence, an estimator value f "'(x) is generated as 

and the approximation for f(x) is obtained using "N" estimators f^'Cx) generated in accordance with 
equation (19) as 



n = i 



The use of a low-discrepancy sequence, illustratively the Halton sequence, will ensure that the 
sample points will not clump, but instead will be evenly distributed over the L-dimensional space 
over which the first "L" terms of the Neumann series (equation (18)) are to be evaluated. 

One problem with using the methodology described above in connection with equations ( 1 7) 
through (20) to evaluate the rendering equation (equation ( 1 5)) is that, although the Neumann series 
(equation (18)) is an infinite series, to evaluate the series at some point the series will need to be 
truncated. In connection with evaluation of the rendering equation (equation (15)), truncation of the 
Neumann series may result in loss of desirable features in the image. To alleviate this problem, in 
accordance with the invention, the computer graphics system 10 uses a methodology which also 
generates an approximation for f(x) using "N" estimators, but which ensures that, for each estimator, 
the number of terms in the series used to generate the estimator is not infinite. Thus, in the 
methodology in accordance with the invention, no truncation is necessary for generation of the 
estimators, thereby ensuring that features of the image will not be lost. 

The methodology in accordance with the invention, which is termed herein the "strictly 
deterministic Russian roulette" methodology, will be described below. Preliminarily, recognizing 
that the numerical value "one" can be represented as an integral as 
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1 = _L I e(w-x)dx (21) 
w J 

0 



where 0(x) denotes the Heaviside function (otherwise known as the "step function") which is defined 
as 

Iforxz 0 



0(x) = 



[Oforx<0 



(22), 



and where "w" is a weight factor from the interval zero (exclusive) to one (inclusive). Using 
equations (21) and (22), a strictly deterministic estimator for the numerical value "one" as 



l(») = l0(w-5^">) = 

at 



— for w ^ C 
w 

Oforw<^ 



in) 

(") 



(23) 



and generating an estimate for the numerical value "one" as 



1=1 = 1 ) . 1 ) l0(v,-^('')) (24). 
N U N U w 

Using equation (21), assuming that K(x,y) takes values in the interval from zero to one, it 
(that is, K(x,y)) can be written as 

Kix^y) = ^QiK(x,y)-x')dx' (25). 

0 



Using equation (25), the Neumann series (equation (18)) is re- formulated as 
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0 0 

- Ill |0(^(x,x,) -x;)0(^:(x,,x2) -x;)gix^)dx^dx;dx^dx; - - 



0 0 0 0 



Comparing equation (26) with equation (18), it will be appreciated that, for every n-dimensional 
integral in equation (1 8), a 2n-dimensional integral has been provided in equation (26), and that, for 
every integration over x, (index 1=1 , 2, ...), an additional integration over x,' is provided in equation 
26. 

As with equation ( 1 7) above, equation (26) is evaluated to provide a numerical approximation 

by performing a low-discrepancy sampling of the first "L" terms of the Neumann series in equation 
(26), where "g(x)" is considered as a zeroth term, using a multi-dimensional low-discrepancy 

sequence (?,'"'. ^'i'"'. ^2'"*. ^'l^"' )> where "n" denotes a sequence index and "2L" is the 

largest number of components that are required in the course of the simulation of length "N." It will 
be apparent from the following that the value of "L" does not have to be known or selected by the 
computer graphics system 10 a priori, and that the successive components and of the low- 
discrepancy sequence can be generated on demand. In one embodiment, each '•2L-dimensional" low- 
discrepancy sequence is illustratively an 2L-dimensional Halton sequence, for which, as described 
above, the elements of the sequence tend to maximally avoid one another. For each elemem of the 
sequence, an estimator value Trr*"^ (x) is generated as 
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(27). 



It will be appreciated that, in equation (27), in the context of the rendering equation (equation (1 5)), 
the term "g(x)" in the sum corresponds to the emitted radiance termi^(x,H') of the rendering 
equation, and the other terms provide an estimate for the integral 

jf(x,w'~yv)G(x ,x') Vi X ,x') L{x',w^dA' in the rendering equation for the particular element 

s' 

of the multi-dimensional Halton sequence used in the generation of the estimator. 

It will be appreciated that from the definition of the Heaviside function (equation (22) that, 
if, at a particular level "I," the value of ^V"> is larger than K($,.,<"»,C,<">), the corresponding Heaviside 
function will be zero at that term, and for successively higher terms in equation (27). Accordingly, 
by formulating the estimator W\x) as in equation 27, the infinite Neumann series is self-truncating 
and therefore reduced to a finite series. Thus, the approximation for f(x) can be obtained as 



Ax) = Ax) = 




(28), 



n=l 



which, in the context of the rendering equation (equation (15)) provides the value for Z, (x ,w), that 

is, the radiance at the point x in the image in the direction w = ( 6 , 4> ) • 

As described above, the methodology described above in connection with equations (21) 
through (28) assumes that K(x,y) takes values in the numerical interval from zero to one. If K(x,y) 
does not take values on that interval, then the methodology can be generalized by taking a fimction 
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p(x,y) that does take values in the interval from zero to one, and writing K(x,y) as -^^^p(x^)an6 



replace the expression (reference equation (25)) by / 0 (p(xj/) -y')dy'.ln that case, the 

estimator value Frr'"' (x) (equation (27)) would be generated as: 



K{x,if^ _,^„)..j:i„). (27a). 



^ ewx.5<'>,-5r>) 5£ ew5<">4"')-5?')K5S"') 

P(x,t,\ 0 Pis. I ^2 > 



With this background, in accordance with the strictly deterministic Russian roulette 
methodology, after the integral kernel Kix,x') = /(i,w'-w) G(i,;') Vix,x') and the emitted 

radiance terml J ^ , w ) have been developed for the rendering equation (equation ( 1 5)) for a point x 

in the scene for which an image is being simulated by the computer graphics system 10, the 
computer graphics system 1 0 generates a numerical approximation of the solution of the rendering 
equation. In that operation, a value for "N," the number of estimators f "'kr(x) to be used in 
generating the approximation fori (J ,w) in the rendering equation (equation (28)) is selected, and 

the computer graphics system 10 generates "N" elements of a multi-dimensional Halton sequence. 
For each such element, the computer graphics system 10 will generate the estimator f"W(x) in 
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accordance with equation (27), In that operation, the computer graphics system 1 0 generates values 
for each successive term of the sum in equation (27), and adds the generated value to the previously- 
generated value(s), until it determines that the term has the value zero. When the computer graphics 
system 10 determines that a temi of the sum in equation (27) is zero, it can terminate operations for 
that particular estimator f "W^)- After the computer graphics system 10 has generated estimators 
f «)jy^(x) for all of the "N" elements of the multi-dimensional Halton sequence that were generated 
as described above, the computer graphics system 10 will generate a numerical approximation for 
the rendering equation as the average of the estimators, as indicated in connection with equation (28). 

Operations described above in connection with the generation of pixel values so as to 
simulate global illumination are depicted on the flow-chart in FIG. 6. Since the operations as 
depicted in that flow-chart will be readily apparent to those skilled in the art from the above 
description, the flow-chart in that FIG. will not be separately described in this specification. 

It will be appreciated by those skilled in the art that the form of the rendering equation as set 
forth above in equation (15), and the various functions therein, are illustrative of the form and 
functions that can be used in connection with generation of pixel values to simulate global 
illumination, and other integral forms and functions will be apparent to those skilled in the art, with 
corresponding changes particularly in equation (27). For example, the specific form of the integral 
and various functions therein may differ from that described above if the computer graphics system 
10 is to simulate global illumination for, for example, different numbers of dimensions than those 
contemplated in the formulation above, or if the simulation is to be performed with multiple colors, 
or if surfaces in the scene are diffuse, glossy or specular (using a so-called "local illumination 
model"), or if a decision is to be made as to whether to reflect or refract a ray at a particular surface. 
Although the formulation of the rendering equation and various functions therein may differ in some 
specific aspects from that described herein, generally, however, the specific rendering equation used 
therefor will have a form corresponding to that set forth in equation (17) above, and so the computer 
graphics system 10 can use the strictly deterministic Russian roulette methodology as described 
above in connection with equations (27) and (28) to evaluate the equation. 

As described above in connection with equation (27), generation of an estimator f "W(x) for 
each "x" makes use of a multi-dimensional low-discrepancy sequence 
(5/"\ ^•|*"\ ^2*"*. )• The "unprimed" components 5/"*, of the sequence are 

related (reference equation (26)) to the integration over the unprimed variables x„ x,, ... , and the 



wo 98/59322 PCT/IB98/010 J 5 



-27- 

"primed" components ^'Z"', of the sequence are related (reference equation (26)) to the 

integration over the primed variables x'„ x', It will be appreciated by those skilled in the art that, 

in some circumstances, it may be desirable to use, instead of the "raw" unprimed components ^,<'", 
^l'"' in generating the estimators f"'RR(x), a selected function or transformation of the 
components of the sequence in generating the estimators f " V(x), which function can be selected to 
ensure that features in the function K(x,y) will be efficiently captured in the evaluation. It is 
generally desirable, however, to ensure that the "raw" primed components ^'i*"', ^V'"* are used 
in generating the estimators f "W(x) even if a function or transformation of the unprimed components 
is used. 

In addition, although the Halton sequence has been indicated as being used to provide the 
sample points for the evaluation, it will be appreciated that other low-discrepancy sequences, which 
are known in the art, could be used instead. 

The strictly deterministic Russian roulette methodology, using a strictly-deterministic low- 
discrepancy sequence -such as a multi-dimensional Halton sequence, as described above in 
connection with equations (21) through (28), provides a number of advantages over both a Monte 
Carlo Russian roulette methodology (that is, a Russian roulette methodology using random 
numbers), as well as a non-Russian roulette methodology as described above in connection with 
equations (1 8) through (20). With respect to a Monte Carlo Russian roulette methodology, as with 
any other Mome Carlo methodology, such a methodology would use random numbers, and thus 
would have similar deficiencies as described above. That is, unlike the strictly-deterministic Russian 
roulette methodology, whose strictly-deterministic low-discrepancy sequence ensures a priori that 
the samplepoints will be generally evenly distributedoverthemulti-dimensionalregionsoverwhich 

the estimators are to be evaluated in a low-discrepancy manner, in comparison to the clumping that 
can result from random numbers used with a Monte Carlo Russian roulette methodology. Thus, the 
strictly-deterministic low-discrepancy Russian roulette methodology can require fewer estimators 
to provide a satisfactory value for the approximation^ than would a Monte Carlo Russian roulette 
methodology. 

In addition, unlike the strictly deterministic Russian Roulette methodology, for the non- 
Russian roulette methodology (equations (18) through (20)), it is generally the case that the 
Neumann series used to generate each estimator f">(x) (equation (19)) is an infinite series. 
Accordingly, each such series needs to be truncated at predetermined maximum number of terms, 
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which can result in loss of features in the image. As described above in connection with equations 
(27) and (28), in the strictly deterministic Russian roulette methodology, for each estimator f " Wx), 
at a particular level "1," the value of the term of the estimator (equation (27)) for that level and any 
subsequent levels will be guaranteed to be zero, so that the series is a finite series. Otherwise stated, 
for the strictly-deterministic Russian roulette methodology, the series (equation (27)) is guaranteed 
to be self-tnmcating, whereas for the strictly-deterministic non-Russian roulette methodology, the 
series (equation (1 9)) is not generally self-truncating and instead will generally require the computer 
graphics system 1 0 to truncate the series. Thus, unlike the strictly-deterministic non-Russian roulette 
methodology, the strictly-deterministic Russian roulette methodology will ensure that no features 
of the image will be lost. 

In addition, generally with an infinite series such as the Neumann series used in connection 
with the estimators f "*(x), the first several terms of the series provide the primary contribution to the 
resulting value of the estimators f^'^x). Because of the self-truncating property, the strictly- 
deterministic Russian roulette methodology improves on the non-Russian roulette methodology (as 
described above in connection with equations (18) through (20)) at least for the reason that the first 
several terms of the Neumann series (which are the most important terms) are taken account in the 
estimator f "*(x) much more often than the following terms of the Neumann series (which are 
generally less important). Thus, the strictly-deterministic Russian roulette methodology can require 
fewer estimators to provide a satisfactory value for the approximation compared to a non-Russian 
roulette methodology. 

Furthermore, since, with the strictly-deterministic Russian roulette methodology, the series 
for each estunator f "W{x) is self-truncating, the methodology allows for an automatic determination 
of whether or not to terminate a ray path in the global illumination simulation. In both equation (18) 
and equation (26), each pair (x,x,), (x„X2),...,(Xi,Xj) represents a respective ray path extending firom 
point "Xj" to point "Xj" in space (to be read fi-om right to left), and, in each estimator, each term 
represents a contribution of the ray to the global illumination simulation. Since, in the strictly- 
deterministic Russian roulette methodology, the series used to generate each estimator ^^^krOO 
automatically self-truncates, for the pair (Xi,Xj) for which the term is zero, the ray path (x,x,), 
(X|,X2),...,(Xi,Xj) automatically terminates. On the other hand, since, as described above, the strictly- 
deterministic non-Russian roulette methodology does not automatically terminate, the ray path does 
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not automatically terminate, but instead will be temiinated at the point associated with the temi for 
which the series is arbitrarily truncated. 

As noted above, the pairs (x,x,), (x,,X2),.".(Xi,Xj) represent a respective ray path extending 
from point "x/* to point "x/* in space. In the strictly-deterministic Russian roulette methodology 
described above in connection with equations (21) through (28), the ray path is assumed to extend 
from a light source. An analogous methodology useful in connection with ray paths extending from, 
for example a camera, will be apparent to those skilled in the art. 

It will be appreciated that a system in accordance with the invention can be constructed in 
whole or in part from special purpose hardware or a general purpose computer system, or any 
combination thereof, any portion of which may be controlled by a suitable program. Any program 
may in whole or in part comprise part of or be stored on the system in a conventional manner, or it 
may in whole or in part be provided in to the system over a network or other mechanism for 
transferring information in a conventional maimer. In addition, it will be appreciated that the system 
may be operated and/or otherwise controlled by means of information provided by an operator using 
operator input elements (not shovra) which may be coimected directly to the system or which may 
transfer the information to the system over a network or other mechanism for transferring 
information in a conventional maimer. 

The foregoing description has been limited to a specific embodiment of this invention. It will 
be apparent, however, that various variations and modifications may be made to the invention, with 
the attainment of some or all of the advantages of the invention. It is the object of the appended 
claims to cover these and such other variations and modifications as come within the true spirit and 
scope of the invention. 

What is claimed as new and desired to be secured by Letters Patent is: 
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Claims 

1 . A computer graphics system for generating a pixel value for a pixel in an image, the pixel being 
representative of a point x in a scene, the computer graphics system generating the pixel value to 

simulate global illumination that is represented by an evaluation of a function f(x) over a sphere 
centered at the point in the scene, the function f(x) having the form /(x) = g^x) + jKix,y)f{y)dy, 

where f(x) (and similarly f(y)) is an unknown function, and g(x) and K(x,y) are known functions, 
with K(x,y) serving as a "kernel" of the integral, the computer graphics system comprising: 
A. an estimator generator for generating a selected number "N" of estimators f "'rr(x) as 

fi^ g(x) - 0(J^(x,p-^f )«(^<''^ 



where 0(x) represents the Heaviside function, and C',""> ^2"", CV"', ^l"". . represem 

components of a predetermined multi-dimensional strictly deterministic low-discrepancy sequence 
and where "n" denotes a sequence index, the estimator generator generating successive terms for 
each estimator f vmtil it generates a term having the value zero; 

B. a luminance value generator for generating a luminance value for the point in the scene as 
the average of said estimator values generated by said estimator generator; and 

C. a pixel value generator for using the luminance value generated for the point in the scene in 
generating the pixel value. 

2. A computer graphics system as defined in claim 1 in which said predetermined low-discrepancy 
sequence is a multi-dimensional generalized Halton sequence. 

3. A computer graphics system as defined in claim 1 in which said estimator generator generates said 
estimators f "'rr(x) as 
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0(;7(x,5;''>)-5';">)s(55''>) 



0(p(x,5;''>)-^';"^) 



where "p(x,y)" represents an arbitrary function which takes values in the interval from zero to one. 

4. A computer graphics system as define'd in claim 1 in which the estimator generator uses in 
generating at least one estimator value as unprimed components CL*"^ unprimed components 
of said low-discrepancy sequence (^,<">. e,<">, ^2^"', 5'2<"V..., Il'^'K ^'l^"' ) which have been processed in 
accordance with a selected transformation. 

5. A computer graphics system as defined in claim 1 in which: 

A. = Z,^(x,vt'), the radiance due to emission from the point X in the direction and 

B. K{x,y) =/(x,w'-H')G(x,x') ^'(i.x'), where 

(i) fiinction /(x,w'-w) is a bidirectional scattering distribution function which 

describes how much light coming from direction w ' is reflected, refracted or 

otherwise scattered in a direction w , and is generally the sum of a diffuse component, 
a glossy component and a specular component; 

(ii) fimction G ( x ,x 0 is a geometric term: 
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cos 6 cos9^ 



(32). 



where 6 and 6 We angles relative to the normals of the respective surfaces at points 
X and X ^ , respectively, and 

(iii) function V(x ,x^) isa visibility function which equals the value one if the point x ^is 

visible from the point x and zero if the point x ^is not visible from the point x . 

6. A computer graphics method for generating a pixel value for a pixel in an image, the pixel being 
representative of a point x in a scene, the pixel value being generated so as to simulate global 

illumination that is represented by an evaluation of an integral over a sphere centered at the point in 
the scene, the integral having the form f(x) = g^x) + f K(x,y)f(y) dy, where fj[x) (and similarly 

f(y)) is an unknown function, and g(x) and K(x,y) are known functions, with K(x,y) serving as a 
"kernel" of the integral, the computer graphics system comprising: 
A. generating a selected number "N" of estimators f "W(x) as 



where 0(x) represents the Heaviside function, and ^2^"\ C*2^"^...m 5V^"' , 

represent components of a predetermined multi-dimensional strictly deterministic low- 
discrepancy sequence and where "n" denotes a sequence index, the estimator generator 



=g(x)-G(^:(x,^p-^t^)g(^;''>) 



+ — 
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generating successive terms for each estimator ^^(x) until it generates a term having the 
value zero; 

B. generating a luminance value for the point in the scene as the average of said estimator 
values; and 

C. using the luminance value generated for the point in the scene in generating the pixel value. 

7. A computer graphics method as defined in claim 6 in which said predetermined low-discrepancy 
sequence is a generalized multi-dimensional Halton sequence. 

8. A computer graphics method as defined in claim 6 in which said estimators f »'rr(x) are generated 
in said estimator generation step as 



/'(x.5?>) 



where "p(x,y)" represents an arbitrary fiinction which takes values in the interval fi-om zero to one. 

9. A computer graphics method as defined in claim 6 in which, in generating at least one estimator 
value as unprimed components ^L^"^ unprimed components of said low-discrepancy 
sequence (^,<"', ^'Z"', iz'"', ^i^"',--. ^l^"'. CV*"' ) are processed in accordance with a selected 
transformation. 

10. A computer graphics method as defined in claim 6 in which 

A. g(x) = L^ix,w), the radiance due to emission from the point x in the direction ;;,; and 



B. 
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function /(x^w^- w) is a bidirectional scattering distribution function which 
describes how much light coming from direction is reflected, refracted or 

otherwise scattered in a direction vv , and is generally the sum of a diffuse component, 
a glossy component and a specular component; 
function G (x,x 0 is a geometric term: 



where 6 and 0'are angles relative to the normals of the respective surfaces at points 
X and X ' , respectively, and 

function r( x ,x 0 is a visibility function which equals the value one if the point x ^is 
visible from the point x and zero if the point % 'is not visible from the point x . 



cose cosG^ 
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FTG. 2 



100. COMPUTER GRAPHICS SYSTEM 10 
IDENTIFIES POINT IN SCENE FOR WHICH PIXEL 
VALUE IS TO BE GENERATED. 



01. COMPUTER GRAPHICS SYSTEM 10 
GENERATES "N" ELEMENTS OF A TWO- 
DIMENSIONAL HALTON SEQUENCE 
REPRESENTING POINTS ON THE LIGHT 
SOURCE WHICH ARE TO BE USED IN 
APPROXIMATION OF THE PIXEL VALUE TO 
PROVIDE FOR APPEARANCE OF SOFT 
SHADOWS IN IMAGE INCLUDING PIXEL WHOSE 
\ ^EL VALUE IS BEING GENERATED. 



/f02. FOR EACH OF THE "N" ELEMENTS OF THE\ 
TWO-DIMENSIONAL HALTON SEQUENCE 
GENERATED IN STEP 101, COMPUTER 
GRAPHICS SYSTEM 10 GENERATES A VALUE 
FOR THE SOFT SHADOWS ILLUMINATION 
FUNCTION (EQUATION (7)), USING THE 
ELEMENT OF THE HALTON SEQUENCE AS THE 
COORDINATES OF THE POINT ON THE LIGHT 
lSOURCE. 



'103. COMPUTER GRAPHICS SYSTEM 10 
GENERATES PIXEL VALUE FOR POINT IN 
SCENE AS AVERAGE OF THE VALUES 
GENERATED IN STEP 102. 
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FTG.3 



110. COMPUTER GRAPHICS SYSTEM 10 
IDENTIFIES POINT IN SCENE FOR WHICH PIXEL 
VALUE IS TO BE GENERATED. 



11. COMPUTER GRAPHICS SYSTEM 10 
GENERATES "N" ELEMENTS OF A TWO- 
DIMENSIONAL HALTON SEQUENCE 
REPRESENTING POINTS (X',Y') ON LENS WHICH 
ARE TO BE USED IN APPROXIMATION OF THE 
PIXEL VALUE TO PROVIDE SIMULATION OF 
DEPTH OF FIELD FOR THE LENS IN IMAGE 
INCLUDING PIXEL WHOSE PIXEL VALUE IS 
BEING GENERATED. 



T2. FOR EACH OF THE "N" ELEMENTS OF THE\ 
TWO-DIMENSIONAL HALTON SEQUENCE 
GENERATED IN STEP 111, COMPUTER 
GRAPHICS SYSTEM 10 GENERATES A VALUE 
FOR THE LUMINANCE FUNCTION L-(BAR) 
(X,Y,X',Y'). USING THE ELEMENT OF THE 
HALTON SEQUENCE AS THE COORDINATES OF 
THE POINT ON THE LENS (X'.Y'). 



i13. COMPUTER GRAPHICS SYSTEM 10 
GENERATES A PIXEL VALUE FOR POINT IN 
SCENE AS THE AVERAGE OF THE VALUES 
GENERATED IN STEP 112. 
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FTG.4 



120. COMPUTER GRAPHICS SYSTEM 10 
IDENTIFIES POINT IN SCENE FOR WHICH PIXEL 
VALUE IS TO BE GENERATED. 



121. COMPUTER GRAPHICS SYSTEM 10 
GENERATES "N" ELEMENTS OF A ONE- 
DIMENSIONAL HALTON SEQUENCE 
REPRESENTING POINTS IN TIME T" WHICH 
ARE TO BE USED IN APPROXIMATION OF THE 
PIXEL VALUE TO PROVIDE SIMULATION OF 
MOTION BLUR IN IMAGE INCLUDING PIXEL 
WHOSE PIXEL VALUE IS BEING GENERATED. 



22. FOR EACH OF THE "N" ELEMENTS OF THE 
ONE-DIMENSIONAL HALTON SEQUENCE 
GENERATED IN STEP 121, COMPUTER 
GRAPHICS SYSTEM 10 GENERATES A VALUE 
FOR THE LUMINANCE FUNCTION L(X,Y,T), 
USING THE ELEMENT OF THE HALTON 
SEQUENCE AS THE POINT IN TIME T" OVER 
WHICH MOTION BLUR IS TO BE GENERATED. 



123. COMPUTER GRAPHICS SYSTEM 10 
GENERATES A PIXEL VALUE FOR POINT IN 
SCENE AS THE AVERAGE OF THE VALUES 
GENERATED IN STEP 122. 
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130. COMPUTER GRAPHICS SYSTEM 10 
IDENTIFIES IMAGE REGION FOR WHICH PIXEL 
VALUES ARE TO BE GENERATED 



31. COMPUTER GRAPHICS SYSTEM 10 
GENERATES "N" ELEMENTS OF A TWO- 
DIMENSIONAL HALTON SEQUENCE 
REPRESENTING POINTS "(X.Y)" ON IMAGE 
REGION FOR WHICH PIXEL VALUES ARE TO BE 
GENERATED, WHICH POINTS ARE TO BE USED 
IN APPROXIMATION OF PIXEL VALUES TO 
PROVIDE SIMULATION OF JITTERING FOR THE 
PIXELS IN THE IMAGE REGION IDENTIFIED IN 
STEP 130. 



/iz2. FOR EACH OF THE PIXELS CONTAINED IN 
THE IMAGE REGION. IDENTIFY THE POINTS 
"(X,Y)" IDENTIFIED BY THE TWO-DIMENSIONAL 
HALTON SEQUENCE GENERATED IN STEP 131 
THAT ARE CONTAINED WITHIN THE AREA OF 

^HE PIXEL. 
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i33. FOR EACH OF THE POINTS IDENTIFIED IN 
STEP 132, COMPUTER GRAPHICS SYSTEM 10 
GENERATES A VALUE FOR THE COLOR 
FUNCTION LPC,Y) USING THE ELEMENT OF THE 
HALTON SEQUENCE AS THE POINT (X,Y) OVER 
WHICH JITTERING IS TO BE GENERATED. 



i34. FOR EACH PIXEL IDENTIFIED IN STEP 132, 
COMPUTER GRAPHICS SYSTEM 10 
GENERATES PIXEL VALUE FOR THE PIXEL AS 
THE AVERAGE OF THE COLOR FUNCTION 
VALUES GENERATED IN STEP 133. 
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/fio. COMPUTER GRAPHICS SYSTEM 10 
SPECIFIES KERNEL K(X,Y) FOR INTEGRAL FOR 
RENDERING EQUATION (EQUATION (15)) FOR 
POINT "X" AND DIRECTION •"W" IN SCENE FOR 
WHICH RADIANCE VALUE L(X,W) IS TO BE 
GENERATED 



141. A VALUE FOR "N." THE NUMBER OF 
ESTIMATORS TO BE GENERATED, IS 
SELECTED AND LOADED INTO A COUNTER 



T 



142. COMPUTER GRAPHICS SYSTEM 10 
ESTABLISHES AND INITIALIZES A RADIANCE 
VALUE ACCUMULATOR 



143. COMPUTER GRAPHICS SYSTEM 
ESTABLISHES AND INITIALIZES A CURRENT 
ESTIMATOR ACCUMULATOR 



I 



} 



^AA, COMPUTER GRAPHICS SYSTEM 10 
GENERATES A VALUE FOR THE EMITTED 
RADIANCE TERM Le(X,W) (EQUATION (15)) AND 
ADDS VALUE TO CURRENT ESTIMATOR 
ACCUMULATOR 



0 
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145. COMPUTER GRAPHICS SYSTEM 10 
GENERATES NEXT COMPONENTS OF ELEMENT 
OF MULTI- DIMENSIONAL HALTON SEQUENCE 




/r46. COMPUTER GRAPHICS SYSTEM 10 USES 
K(X,Y) AND COMPONENTS OF MULTI- 
DIMENSIONAL HALTON SEQUENCE 
GENERATED IN STEP 145 TO GENERATE 
VALUE FOR TERM OF ESTIMATOR (EQUATION 



^YESi. 



'1 47. COMPUTER GRAPHICS SYSTEM 1 0 
DETERMINES WHETHER VALUE GENERATED IN 

STEP 146 IS ZERO 



^48. COMPUTER GRAPHICS SYSTEM 10 ADDS 
VALUE GENERATED IN STEP 146 TO CURRENT 
ESTIMATOR ACCUMULATOR 



6 
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(4) 



^4S COMPUTER GRAPHICS SYSTEM 10 ADDS 
CONTENTS OF CURRENT ESTIMATOR 
ACCUMULATOR TO RADIANCE VALUE 
ACCUMULATOR 



150. COMPUTER GRAPHICS SYSTEM 10 
DECREMENTS COUNTER 



151 COMPUTER GRAPHICS SYSTEM 10 
DETERMINES WHETHER CURRENT VALUE OF 
COUNTER IS ZERO 



YES 



-NO 



i 



152. COMPUTER GRAPHICS SYSTEM 10 DIVIDES 
CONTENTS OF RADIANCE VALUE 
ACCUMULATOR BY "N" TO GENERATE 
RADIANCE VALUE L(X,W) 
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